[ETR Vol. 11] Data Engineering, Fast And Slow


Extract. Transform. Read.

A newsletter from Pipeline: Your Data Engineering Resource

Hi past, present or future data professional!

I bet when you think of data engineering (or software engineering, for that matter) you don’t think about development pace. After all, the buzzworthy anecdotes and lofty promises surround performance of a build, not the speed of its architects.

But adaptability and the ability to work very quickly at times is a role expectation you won’t see listed on a job opening. I’ll be very honest–I’ve had days and weeks where things are painfully slow. You almost want a pipeline to break just to say you did something during a work day.

Then there are the rare days where you receive an assignment in the morning and are expected to complete it by day’s end. Being able to calm your nerves, act methodically and gather concrete requirements is the name of the game in either scenario.

And don’t forget, even if you’re not the engineer handling an urgent task, do your part to be the ultimate team player to support classmates, peers and other professionals who seem overwhelmed.

Reduce complexity. Remove burdens–no matter what pace you operate at (or are dictated).

If I can help you by answering a question, shoot me an email: zach@pipelinetode.com.

To leave you plenty of development time, here are this week’s links as plain text:

Thanks for ingesting,

-Zach

Pipeline To DE

Top data engineering writer on Medium & Senior Data Engineer in media; I use my skills as a former journalist to demystify data science/programming concepts so beginners to professionals can target, land and excel in data-driven roles.

Read more from Pipeline To DE

Extract. Transform. Read. A newsletter from Pipeline: Your Data Engineering Resource Hi past, present or future data professional! Somewhere along your professional development journey someone lied to you. They told you to crank out resumes because no one reads cover letters. This couldn’t be further from the truth as 87% of hiring managers read cover letters. Such a high read rate represents a compelling opportunity to sell your data skills and showcase a bit of personality. The problem?...

The Latest From Pipeline: Your Data Engineering Resource Hi past, present or future data professional! I hope you’ll indulge my sharing of an important career milestone; unfortunately, I’m not retiring with a gold Rolex snug on my wrist. Instead, this week marks 3 years in data engineering. I’m excited about this work-iversary because it marks a period of time in which I’ve been working in data engineering longer than my prior non-data job. If you’ve read my work you know I’ve taken an...

Extract. Transform. Read. A newsletter from Pipeline: Your Data Engineering Resource Hi past, present or future data professional! Browsing through files recently, I found 100+ old resumes I used to apply for data jobs in 2021. While data science is sold as a “good career”, the truth is it’s always been tough to break in. Those looking for jobs need to do more than ever to distinguish themselves. For anyone looking for a job you may have been taught to network with recruiters and hiring...